ChatGPT

presented by
Health Tech

In This Round, Humans 1, AI LLMs 0

Anthropic's Claude3-Opus performed better than GPT-4, but both fell short of humans on a test of objective medical knowledge. The study was conducted by a firm developing LLMs specifically for healthcare that claim to be incorporating peer-reviewed sources of information.

Hospitals, Health Tech, Artificial Intelligence, Providers

Research Shows Generative AI In The EHR Can Work Well, But Only With Human Oversight

Mass General Brigham researchers conducted a study to learn more about the efficacy of large language models when used to draft responses to patient messages in the EHR. The results showed that these AI tools can do a good job at reducing physicians’ workloads and improving patient education — but also that these tools have limitations that require human oversight.

presented by
Health Tech

Advice Given by ChatGPT Vs. Human Providers Is Nearly Indistinguishable, NYU Study Says

NYU researchers conducted a study this year in which nearly 400 people were asked to identify whether responses to patient questions were produced by human providers or ChatGPT. Participants had a limited ability to tell the source of the responses apart, so the study authors concluded that the use of LLMs like ChatGPT could be an effective way to streamline healthcare providers’ communication with patients.

Health Tech

UNC Health Pilots In-House Generative AI App to Alleviate Burnout

UNC Health recently launched a pilot for its in-house generative AI app called Ava, which stands for “AI virtual assistant.” The app allows staff members to ask questions about the different digital health tools available to them across the health system, and it gives them concise answers about how to use the tools effectively. The goal is to prevent staff from searching through vast training libraries.

Health Tech

ChatGPT Outperforms Doctors In Answering Patient Messages, Study Shows

A new study found that ChatGPT might actually be quite successful in providing high-quality answers to patient questions during an era in which doctors and nurses are too busy to do so. The research evaluated two sets of answers to patient inquiries — one written by physicians, the other by ChatGPT. A panel of healthcare professionals determined that ChatGPT's answers were significantly more detailed and empathetic.